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© Determining offset between images of an IC. 



© Offset between a pair of images is determined 
using parallel processing techniques in a general- 
purpose digital serial processor. For each image, a 
patch of pixels is selected and convolved with a 
Laplacian kernel. The result is convolved with a 
Gaussian kernel in each of the x- and y- directions to 
produce a registration image. The registration im- 
ages are binarized, bit-packed, and correlated to one 
another by performing an EXOR operation for each 
pixel location at each of a plurality of relative offsets 



of the images. The results of the EXOR operation 
are summed to produce an image-correlation value 
for each relative offset. The image-correlation in- 
dicating highest correlation determines relative offset 
of the images. The determined offset can be used 
for a variety of purposes in automating control of E- 
beam and FIB systems, to register images to one 
another or to identify a location in one image which 
corresponds to a selected location of the other im- 
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BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention relates to determining 
offset between images such as images of an in- 
tegrated circuit device, useful in automating opera- 
tion of charged-particle beam systems. 

2. The Prior Art 

Charged-particle beam systems are used in 
verification, characterization, design debug and 
modification of devices such as ICs. Electron-beam 
(E-beam) systems are used to acquire and observe 
waveforms on internal nodes of a device as the 
device is exercised, and to produce voltage-con- 
trast images. Focused-ion-beam (FIB) systems are 
commonly used for: (1) etching/milling, such as 
cutting metal lines and drilling holes, (2) depositing 
material, such as forming metal connectors and 
pads, and (3) scanning ion microscope (SIM) ob- 
servation. 

Figure 1 shows three main elements of a 
charged-particle beam system 110: electron-beam 
or FIB probe 112, circuit exerciser 114, and data 
processing system 116 with display terminal 118. 
Data processing system 116 has a processor P 
with memory M and data store D. Circuit exerciser 
114 applies a test-vector pattern via bus 124 to 
device 126 in vacuum chamber 128. The beam is 
directed at locations of device 126 under control of 
data processing system data sent to probe 112 by 
data processing system 116 over bus 122. System 
110 is controlled by commands supplied through 
display terminal 118. 

Figure 2 shows a prior-art test probe 1 1 2 hav- 
ing three elements mounted to surface 225: a 
stage 226, a probe card 228, and a focused-beam 
column 229. Column 229 generates a charged- 
particle beam directed along axis 236. The beam 
passes through openings in surface 225 and probe 
card 228. The point at which the beam strikes 
device 126 (shown as a wafer) is determined by 
the position of column 229 (controllable by means 
of an x-y stage 240) and by the deflection of the 
beam (controllable by means of x-y deflection coils 
241 ). 

Such systems combine the display of a sche- 
matic circuit diagram, layout mask data and a live 
scanning-electron microscope (SEM) or scanning- 
ion microscope (SIM) image of the chip, along with 
analog and/or digital waveforms. The SEM (or 
SIM), layout and schematic displays are linked 
together to facilitate navigation around the IC chip. 
When the user pans (moves laterally) or zooms 
(changes magnification) one of the linked displays, 
the others pan or zoom accordingly. When the user 



places a probe Icon at a point on one of the linked 
displays, expected waveforms and actual measured 
waveforms at that point may be displayed for com- 
parison. 

5 The SEM (or SIM) image is related to the 

layout image much as an aerial view is related to a 
topographic or relief map of the same terrain. The 
SEM (or SIM) image is the "aerial view" of the 
chip, and the layout image is the "topographic 
70 map." A qualitative difference is the causality; a 
topographical map is likely made from the aerial 
view, whereas the IC chip was manufactured ac- 
cording to the layout masks. 

Figure 3 shows linked schematic, layout, and 
75 SEM images produced with magnification set for a 
wide field of view. The display is normally in colors 
to show additional information such as the layer or 
net to which a displayed feature belongs. Sche- 
matic image 310 represents a portion of a circuit. 
20 Layout image 320 and SEM image 330 represent 
approximately the same portion of the circuit. 
Superposed on layout image 320 and SEM image 
330, are boxes representing a layout window 340 
and a SEM window 350 which delimit the field of 
25 view of the probe for a given stage position at an 
increased level of magnification. That is, as the 
field of view is zoomed in and out, the displayed 
images zoom in and out correspondingly. Layout 
window 340 and SEM window 350 represent ap- 
30 proximately the same field of view of the device 
once the images have been linked. 

The beam can be directed at any location on 
the device within the field of view. Typically, the 
positions an icon on a schematic or layout image to 
35 indicate a location on the device at which the beam 
is to be directed. Figure 4A shows a synthetic 
("layout") image 400 generated from CAD data 
describing the IC. Figure 4B shows a SEM image 
405 of a portion of an integrated circuit. The field of 
40 view (FOV) of Figure 4A corresponds to the FOV of 
Figure 4B. In Figure 4A is an icon 410 representing 
a location at which the beam is to be directed. Icon 
415 marks the corresponding location in Figure 4B. 
Data processing system 116 uses the relationship 
45 between the linked schematic/layout image infor- 
mation to control x-y stages 226 and/or 240 and 
beam deflection coils 241 to direct the beam at the 
selected location. 

Directing a focused beam at an individual de- 
50 vice feature having a dimension of £ 1 urn has led 
to use of precision x-y stages and interferometers 
for positioning. Accurate positioning of the beam 
can be difficult and time-consuming. As geometries 
of circuits become smaller, keeping the CAD layout 
55 information aligned with the SEM (or SIM) image 
becomes more difficult. This is primarily due to 
errors in stage movement and translation errors 
resulting from field effects. Field effects may be 
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global and/or local. Global field effect results in 
beam deflection due to changing electric fields 
over a large area of the device, such as a large 
lead frame or ground plane. Local field effect re- 
sults in deflection of the beam due to changing 5 
electric fields at a localized area, such as when the 
area has latched data or is transitioning quickly 
between voltage levels. Such errors may demand 
additional operator inputs to effect fine adjustment 
of-flhe beam position relative to a selected device 10 
feature after automatic positioning is completed. 
This need for operator intervention limits the ability 

to automate repetitive operations 

Methods and apparatus for registration of im- 
ages are known in the art. A binocular-stereo- 75 
matching technique has been proposed for reg- 
istration of a SEM image of an integrated circuit 
with a synthetic image generated from a database 
describing physical connections of the integrated 
circuit. The technique is influenced by Marr and 20 
Poggio's zero crossing theory, but uses the 
Laplacian of the Gaussian convolution sign repre- 
sentation with the autocorrelation function to deter- 
mine disparity between two stereo images. The 
following steps are proposed: 25 
o Convolve grey-level images with a digital ap- 
proximation of the Laplacian operator, fol- 
lowed by convolution with a Gaussian 
smoothing operator; 
■~o Binarize on the convolution of the sign; 30 
>'0 Correlate regions of the binarized images us- 
- ing a pixel-wise exclusive-OR (EXOR) func- 
.* tion over a range of possible displacement 
values in x and y, and report the displace- 
ment values at which the highest area cor- 35 
relation was measured. 
This approach is described in U.S. Patent No. 
5,109,430, issued April 28, 1992 to H.K. Nishihara 
et aL and U.S. Patent Application No. 07/731,378 
filed July 16. 1991 of H.K. Nishihara et a/., and in 40 
H. NISHIHARA, Practical real- time imaging 
stereo matcher, OPTICAL ENGINEERING 23(5), 
September/October 1984, pp. 536-545, the con- 
tents of all of which are incorporated herein by this 
reference. The Nishihara et ai. disclosures con- 45 
template specialized image-processing hardware 
for implementing the technique, due to the undesir- 
ably long computation times required to accom- 
plish image registration using general-purpose digi- 
tal processors. 50 

SUMMARY OF THE INVENTION 

The present invention offers methods for rap- 
idly determining offset between images, such as a 55 
CAD layout image of an IC device and a SEM 
image of the device. Offset is determined using 
parallel processing techniques in a general-purpose 



digital serial processor. The methods are reliable 
and tolerant of noise. 

Each of a pair of images is defined by stored 
pixel data describing a respective plurality of pix- 
els. Each pixel is defined by a location within an x- 
y grid and an intensity value. For each image, a 
patch of pixels is selected and convolved with a 
Laplacian kernel. The result is convolved with a 
Gaussian kernel in each of the x- and y- directions 
to produce a registration image. The registration 
images are binarized, bit-packed, and correlated to 
one another by performing an EXOR operation for 
each pixel location at each of a plurality of relative 
offsets of the images. The results of the EXOR 
operation are summed to produce an image-cor- 
relation value for each relative offset. The image- 
correlation indicating highest correlation determines 
relative offset of the images. The determined offset 
can be used to register the images to one another 
or to identify a location in one image which cor- 
responds to a selected location of the other image. 

The methods can be used for a variety of 
purposes in automating control of E-beam and FIB 
systems, such as compensating for stage-position- 
ing errors and field effects in positioning an E- 
beam probe. For example, a probe location such 
as an x-y coordinate is selected from a CAD layout 
image of an IC. A patch of the layout image includ- 
ing the x-y coordinate is then processed to pro- 
duce a first registration image. The SEM position- 
ing stage is moved to acquire a SEM image of the 
IC at a field of view including the selected coordi- 
nate. The SEM image is processed to produce a 
second registration image. The registration images 
are binarized, bit-packed and correlated to deter- 
mine offset between the layout image and the SEM 
image. The determined offset is used to determine 
a corrected coordinate for placing the E-beam 
probe at a location on the IC corresponding to the 
location selected from the layout image. 

Other features and uses of the invention will 
become apparent to those of skill in the art from 
the description which follows with reference to the 
drawing figures. 

BRIEF DESCRIPTION OF THE DRAWING 

Figure 1 is a block diagram of a prior-art 
charged-particle probe system; 
Figure 2 illustrates a prior-art electron-beam test 
probe forming part of a system of the kind 
illustrated in Figure 1; 

Figure 3 illustrates an example of linked sche- 
matic, layout, and SEM images, with field-of- 
view windows superposed on the layout and 
SEM images; 

Figure 4A shows a synthetic image of a portion 
of an integrated circuit, generated from com- 



BNSDOCID: <EP 0619551A2_L> 



5 



EP 0 619 551 A2 



6 



puter-aided design data; 

Figure 4B shows a SEM image of a portion of 
an integrated circuit, corresponding to the syn- 
thetic image of Figure 4A; 

Figure 5 is a flow diagram illustrating principal 
steps of a probe-placement process in accor- 
dance with the invention; 

Figure 6 shows a SEM image and illustrates 
desired probe beam placement relative to the 
conductor in accordance with the invention; 
Figure 7 shows a layout image of a portion of an 
integrated circuit- 
Figure 8 shows a SEM image of a portion of an 
integrated circuit; 

Figure 9A shows preferred kernel coefficients for 
Laplacian convolution; 

Figure 9B shows a method of convolving an 
image with a Laplacian kernel; 
Figure 10A shows a patch of the layout image of 
Figure 7; 

Figure 10B shows a Laplacian image resulting 
from convolution of the patch of Figure 10A with 
the Laplacian kernel of Figure 9A; 
Figure 11 A shows patch of the SEM image of 
Figure 8; 

Figure 11 B shows a Laplacian image resulting 
from convolution of the patch of Figure 11A with 
the Laplacian kernel of Figure 9A; 
Figure 12 shows an example of coefficients for a 
Gaussian convolution kernel; 
Figure 13 shows shift and add operations for 
factoring and creating multiplier images in per- 
forming Gaussian convolution; 
Figure 14 illustrates the first step of the x-axis 
Gaussian convolution; 

Figure 15 illustrates the second step of the x- 
axis Gaussian convolution; 
Figure 16 illustrates the first step of the y-axis 
Gaussian convolution; 

Figure 17 illustrates the second step of the y- 

axis Gaussian convolution; 

Figure 18A shows a layout image patch; 

Figure 18B shows a registration image produced 

by convolving the layout image patch of Figure 

18A with the Laplacian and Gaussian operators 

in accordance with the invention; 

Figure 19A shows a SEM image patch; 

Figure 19B shows a registration image produced 

by convolving the SEM image patch of Figure 

19A with the Laplacian and Gaussian operators 

in accordance with the invention; 

Figure 20 shows an example of coefficients for a 

Gaussian convolution kernel; 

Figure 21 shows a series of images juxtaposed 

to illustrate the autocorrelation objective of the 

invention, in which (a) is a CAD layout image 

patch, (b) is a registration image prepared from 

the layout image patch in accordance with the 



invention, (c) is a SEM image patch, (d) is a 
registration image prepared from the SEM im- 
age patch in accordance with the invention, (e) 
and (g) are portions of the layout image patch, 

5 (f) is an overlay of the SEM registration image 

and the layout registration image, and (h) is an 
overlay of the SEM registration image and the 
layout registration image with mismatching pix- 
els shown in black and matching pixels shown in 

w white; 

Figure 22A is an autocorrelation surface pro- 
duced by mapping values for autocorrelation of 
images (d) and (b) of Figure 21; 
Figure 22B shows autocorrelation values along 

15 the x-axis of an x-2 plane intersecting the cor- 
relation peak of the surface of Figure 22A; 
Figure 22C shows autocorrelation values along 
the y-axis of a plurality of y-2 planes intersecting 
the surface of Figure 22A; 
20 Figure 23 illustrates bit-packing of registration 
images; 

Figure 24 illustrates selection of correlation 
patches from a registration image for optimized 
autocorrelation; 
25 Figure 25 illustrates a method of optimized auto- 
correlation; 

Figure 26 illustrates a method of preparing a 
stack of difference images for IC fault diagnosis; 
Figure 27 illustrates a method of automating 
30 repair of a batch of IC devices; 

Figure 28 illustrates a method for calibrating 
image offset when beam current is changed; 
Figure 29 illustrates a method of long-duration 
waveform acquisition. 

35 

DESCRIPTION OF PREFERRED EMBODIMENTS 

Image registration methods in accordance with 
the invention will first be described with reference 

40 to a specific example involving operation of an E- 
beam probe system such as the Schlumberger 
"IDS 5000™ " system. 

An IC is to be probed at a selected physical 
location with an E-beam probe. The location is 

45 selected by reference to a layout image. Figure 4A 
shows layout image 400 and selected location 410. 
The probe system uses linked layout and SEM 
data to determine a field of view encompassing the 
selected location. The field of view is set, and a 

50 SEM image is acquired encompassing the selected 
location, and the probe beam is positioned within 
the field of view. Figure 4B shows a SEM image 
and the desired probe location 415. Actual place- 
ment of the probe using prior-art probe systems 

55 may not coincide with the desired placement, due 
to stage errors, field effects, or other causes. 

Probe placement can be corrected without hu- 
man intervention by determining an offset between 
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the layout image and the SEM image. Figure 5 
shows principal steps of a probe beam placement 
process in accordance with the invention: 

500 . Determine and set SEM magnification 

and initiate stage motion to position the s 
SEM, so the field of view of the SEM 
image will encompass the selected lo- 
cation. 

»j510. While the stage is in motion, prepare a 

first registration image, such as by pro- io 
cessing a CAD layout image or by in- 
>. dexing a previously-processed layout 

image. 

520 . Wait for the x-y stage to stop moving. 

530. When the stage has reached the de- 75 
sired location, acquire a SEM image. 

540. Prepare a second registration image 
from the newly-acquired SEM image by 
convolving and binarizing a patch of the 
SEM image. 20 

550. Determine offset between the first and 
second registration images using an 
autocorrelation process. The offset is to 
be applied in placing the probe beam. 

560 . Place the probe beam, taking into 25 
account the determined offset. 

Setting magnification 

v Magnification of a SEM or SIM can be con- 30 
trolled in a manner analogous to that of an optical 
microscope, by controlling magnetic fields of the 
beam-optical column. Magnification of the images 
to be registered is preferably set so as to minimize . 
the search area for the autocorrelation and thus 35 
minimize processing time. Choosing magnification 
with respect to the smallest feature size to be 
matched during the autocorrelation limits the 
search area required to compensate for stage error 
and field effects. This increases the speed of the 40 
autocorrelation and brings more structures into the 
field of view to be matched. 

In this example, determining the offset makes it 
possible to accurately place the probe beam on a 
conductor of the IC. In general, the edge of a 45 
conductor is not considered to be a good place to 
probe. It is assumed for this example that the 
probe is to be placed to within one-third margin of 
the conductor width (i.e., not less than one-third of 
the width of the conductor from the edge of the 50 
conductor). Autocorrelation of the processed im- 
ages will be carried out pixel-by-pixel, assuring 
offset between images will be determined to within 
± 1 pixel. 

Magnification can be set in this example such 55 
that the smallest feature to be matched during 
autocorrelation will be approximately seven pixels 
in width. Referring to Figure 6, a conductor 610 



within SEM image 405 is to be probed. If mag- 
nification is set such that conductor 610 is seven 
pixels wide in the SEM image, as shown by the 
band of seven pixel locations (squares) 620. It is 
desired to place the center of the probe beam, 
represented by dot 630, at a location correspond- 
ing to the central pixel location 640. Since offset 
between the images is determined to within ± 1 
pixel, placement of the probe beam can be assured 
within ± 1 pixel, e.g., at one of the three pixel 
locations shown by arrow 650 in the center section 
of band 620. Placing the probe beam at one of the 
pixel locations shown by arrow 660 or by arrow 670 
is undesirable because these represent the edge of 
the conductor. 

Selecting a "patch" from the first image 

While the SEM stage is in motion, a first reg- 
istration image is prepared from the first image 
(e.g., the layout image). Figure 7 shows a first 
(layout ) image 700. While the entire image 700 
could be processed for use in autocorrelation, it is 
preferred to process only a portion (a "patch" 710) 
of the image, to minimize processing time. The 
patch encompasses the selected location for probe 
placement location. "Patch" 710 is shown in Figure 
7 as a cut-out from image 700 for illustration pur- 
poses. 

The selected x-y location to be probed lies 
within a region 720 outlined by dashed lines in 
Figure 7. Region 720 is large enough to assure that 
the full width of the conductor to be probed lies 
within the region. For example, if magnification is 
set so that the smallest feature to be probed (e.g., 
a 1 micron-wide conductor) is 7 pixels wide, region 
720 can be on the order of 100x100 pixels. 

The size of patch 710 is determined from the 
size of region 720 and from the maximum ex- 
pected offset error in each of the x- and y- direc- 
tions. If the maximum expected offset error (e.g., 
due to stage error and field effects) is ± 2 microns 
(where 1 micron is represented by 7 pixels), then it 
is sufficient if patch 720 is larger than region 710 in 
each of the x- and y- directions by an amount 
equal to twice the maximum expected offset error 
(e.g., 2x2 microns, or 28 pixels). Thus, if region 
720 is represented by 100x100 pixels and the 
maximum expected offset error is represented by 
14 pixels, then patch 710 can have a dimension of 
128x128 pixels. 

The first registration image is prepared by pro- 
cessing the pixels of patch 710 as described be- 
low. The first registration image will be used as a 
"search area" during autocorrelation. 
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Selecting a "patch" from the second image 

When the stage motion is completed, a second 
(e.g., SEM) image is acquired at the new stage 
position. Figure 8 shows such a SEM image 800. 
The field of view of SEM image 800 is determined 
by the magnification set as described above. A 
"patch" 810 of SEM image, shown cut-out for 
illustration purposes, is selected for processing. 
The size of patch 810 is preferably about that of 
region 720 in Figure 7. The x-y coordinate position 
selected for probing lies within patch 810. Because 
the offset (e.g., due to stage-positioning and field- 
effect errors) between the respective coordinate 
systems of the linked layout image and the SEM 
image is thus far unknown, the selected x-y coordi- 
nate position may not coincide on the SEM image 
with the feature to be probed. 

Patch 810 is processed as described below to 
prepare a second registration image used in carry- 
ing out the autocorrelation, as described below. 
While the entire SEM image could be processed, 
processing only a patch reduces the time to create 
the second registration image and to perform the 
autocorrelation. Reliability of the autocorrelation re- 
sult generally increases with the size of the reg- 
istration images, though large patch sizes bring in 
not only more surface topology to be matched but 
also more noise. Selection of patch sizes is thus a 
balance between processing time and reliability. In 
this example, a patch 810 of 100x100 pixels is 
selected as a balance between processing time 
and autocorrelation reliability. Larger patch sizes, 
e.g., 128x128 or 256x256, have also been used 
successfully. For some applications, such as pre- 
cise FIB operations, it may be desirable to select 
high magnification and relatively large patch size. 

Preparing registration images 

The first and second image patches (e.g., 710 
and 810) are processed to produce the first and 
second registration images. This is done in accor- 
dance with the invention by performing a Lapfacian 
convolution followed by Gaussian smoothing. 

Figure 9A shows preferred coefficients of a 
Laplacian kernel 900 for the Laplacian convolution. 
Advantages of the Laplacian convolution include 
independence of absolute brightness, and a zero- 
mean resultant image which helps to prevent in- 
teger overflow in carrying out the Gaussian con- 
volution. 

Figure 10A again shows layout patch 710. Fig- 
ure 10B shows a Laplacian image patch 1010 re- 
sulting from convolution of patch 710 with the 
Laplacian kernel of Figure 9A. Comparison of Fig- 
ures 10A and 10B reveals that the Laplacian con- 
volution detects "edges" in the image pattern. 
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Figure 11A again shows SEM image patch 810. 
Figure 11 B shows a Laplacian image patch 1110 
resulting from convolution of patch 810 with the 
Laplacian kernel of Figure 9A. Comparison of Fig- 
5 ures 11A and 11B reveals that application of the 
Laplacian to a SEM image emphasizes noise in the 
SEM image. This noise will be smoothed by Gaus- 
sian convolution. Gaussian convolution provides tol- 
erance of images having low contrast, noisy back- 
io ground, damaged patterns and background de- 
fects. Width of the Gaussian convolution kernel 
allows control over the size of features to be cor- 
related. 

The Laplacian convolution is implemented in a 
15 tight, single-pass processing loop. Referring to Fig- 
ure 9A, the intensity value of a pixel of the original 
image patch is multiplied by the center kernel 
coefficient 910 (having a value of 4). Each north, 
south, east, west neighboring pixel is multiplied by 
20 the corresponding kernel coefficient (having a value 
of -1). The sum of the products is taken as the 
intensity value for a pixel of the Laplacian patch at 
an x-y location corresponding to the x-y location of 
the pixel of the original image patch. The process 
25 is repeated for each pixel of the original image 
patch to produce the Laplacian patch. 

The original image patch preferably resides in 
memory and shift operations are used instead of 
multiplication. Offsets to the neighbor pixels are 
30 predetermined. Data and address registers of the 
microprocessor are used to optimize performance. 
Figure 9B illustrates an exemplary method in ac- 
cordance with the invention of convolving an image 
with a Laplacian kernel. Pixel intensity values of the 
35 image patch to be convolved are stored in a mem- 
ory 920. For a given pixel location 925 in memory, 
the neighboring pixel intensity values at 930, 935, 
940 and 945 (to the north, south, east and west, 
respectively) are summed in accumulator 950, and 
40 the pixel intensity value at location 925 is shifted 
left two places and subtracted from the sum in the 
accumulator. The resulting value in the accumulator 
is stored in location 955 in memory 960. The value 
stored at location 950 is taken as the intensity 
45 value of a pixel of the resultant Laplacian image. 
The pixel address is then incremented, and the 
process repeated. 

Figure 12 shows coefficients of a preferred 
Gaussian convolution kernel 1200. The Laplacian 
50 patch is to be convolved with kernel 1200 in each 
of the x- and y- directions to produce a registration 
image. Conceptually, the intensity value for a given 
pixel location of the registration image is to be 
determined as follows. The intensity value of a 
55 pixel at the corresponding location of the Laplacian 
patch is multiplied by the center coefficient 1210 
(having a value of 20). The intensity value of the 
neighboring pixel of the Laplacian patch in each of 

6 
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the north, south, east and west directions is multi- 
plied by the next adjacent coefficient 1220, 1230, 
etc. (having a value of 15). The intensity value of 
the next nearest pixel of the Laplacian patch in 
each of the north, south, east and west directions is 5 
multiplied by the next respective coefficient 1240, 
1250, etc. (having a value of 6). The intensity value 
of the next nearest pixel of the Laplacian patch in 
eacbtof the north, south, east and west directions is 
. multiplied by the next respective coefficient 1260, io 
1270, etc. (having a value of 1). The sum of the 
products is taken as the intensity value for the 
given pixel location of the registration image. The 
intensity value for each pixel location of the reg- 
istration image can be determined in this manner. 75 

However, the present invention offers more effi- 
cient methods of achieving the same result. The 
Gaussian convolution is carried out for each pixel 
location as two one-dimensional convolutions (e.g., 
a convolution in the x- direction followed by a 20 
convolution in the y- direction) to minimize com- 
putational effort. This approximates a circular Gaus- 
sian smoothing function. Each of the one-dimen- 
sional convolutions is broken down into two further 
steps designed to reduce the number of math 25 
operations. 

Figures 13 and 14 illustrate the first step of the 
x-axis Gaussian convolution. Referring to Figure 14, 
zero-mean Laplacian image 1400 is used to create 
multiplier images 1410, 1420 and 1430, each of 30 
these multiplier images representing the Laplacian 
image multiplied by a respective one of the Gaus- 
sian .kernel coefficients, 6, 15 and 20. Laplacian 
image 1400 can be taken as a multiplier image 
representing Laplacian image 1400 multiplied by 35 
Gaussian kernel coefficient 1. 

In preparing multiplier images, repetitive mul- 
tiplication operations are avoided by bit-shifting 
pixel intensity values and factoring the Gaussian 
kernel values. Referring to Figure 13, the intensity 40 
value of a pixel is effectively multiplied by each of 
the Gaussian kernel coefficients through a series of 
shift, addition, and subtraction operations. The in- 
tensity value of a pixel of Laplacian image 1400 is 
stored as a binary value 1? in a register A. The 45 
stored value is left-shifted one place, resulting in a 
multiplication by 2, and stored in a register B as a 
binary value 2tf. The value stored in register B is 
left-shifted one place, resulting in a multiplication 
by 2, and stored in a register C as a binary value 50 
4tf. The value stored in register C is left-shifted two 
places, resulting in a multiplication by 4, and stored 
in a register D as a binary value 16tf. The values 
stored in registers B and C are added and stored 
in a hardware register E as a binary value 6tf. The 55 
value 2tf stored in register A is subtracted from the 
value 16tf stored in register D and the resulting 
value 15tf is stored in a hardware register F. The 



values stored in hardware registers C and D are 
added and stored as a binary value 20tf in a 
hardware register G. Registers A, E, F and G 
contain the intensity value of the Laplacian image 
pixel multiplied respectively by the Gaussian kernel 
values 1,6, 15 and 20. The process is repeated for 
each pixel of the Laplacian image to produce a 
multiplier image for each value of the Gaussian 
kernel. 

Referring to Figure 15, multiplier images (1400, 
1410, 1420 and 1430) can be stored as a single 
data structure 1500 to minimize the number of 
registers required. Offsets into the structure point 
to the beginning of each separately multiplied im- 
age. Data structure 1500 comprises pixel intensity 
values of the Laplacian image (1400), pixel values 
of the Laplacian image multiplied by 6 (1410), pixel 
values of the Laplacian image multiplied by 15 
(1420), and the pixel values of the Laplacian image 
multiplied by 20 (1430). 

The second step of the x-axis Gaussian con- 
volution is also illustrated in Figure 15. The inten- 
sity value for each pixel of a resultant image 1510 
is derived by adding together selected pixel inten- 
sity values from data structure 1500. That is, the 
intensity value for a given pixel location 1520 of the 
resultant image is determined by adding together: 
o the values of two pixels 1525 and 1530 from 
the one-multiplier Laplacian image 1400, the 
locations of pixels 1525 and 1530 being off- 
set in the x-direction by three pixel locations 
from the pixel location of Laplacian image 
1400 which corresponds to pixel location 
1520, and 

o the values of two pixels 1535 and 1540 from 
the six-multiplier image 1410, the locations of 
pixels 1535 and 1540 being offset in the x- 
direction by two pixel locations from the pixel 
location of the 6-multiplier image 1410 which 
corresponds to pixel location 1 520, and 
o the values of two pixels 1545 and 1550 from 
the fifteen-multiplier image 1420, the loca- 
tions of pixels 1545 and 1550 being offset in 
the x-direction by one pixel location from the 
pixel location of the 15-multiplier image 1420 
which corresponds to pixel location 1520, and 
o the value of a pixel 1560 from the twenty- 
multiplier image 1430, the location of pixel 
1560 corresponding to pixel location 1520. 
The sums are completed to produce an intensity 
value for each pixel location of resultant image 
1510, so that resultant image 1510 represents the 
convolution of Laplacian image 1400 with Gaussian 
kernel 1200 in the x- direction. 

Figures 13 and 16 illustrate the first step of the 
y-axis Gaussian convolution. Referring to Figure 
16, resultant image 1510 is used to create multi- 
plier images 1610, 1620 and 1630, each of these 
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multiplier images representing the resultant image 
multiplied by a respective one of the Gaussian 
kernel coefficients, 6, 15 and 20. Resultant image 
1510 can be taken as a multiplier image represent- 
ing resultant image 1510 multiplied by Gaussian 
kernel coefficient 1. The multiplier images are pre- 
pared using the method described with reference 
to Figure 13 (except that this time the pixels of the 
resultant image are processed rather than pixels of 
the Laplacian image). These multiplier images 
(1510, 1610, 1620 and 1630) can be stored as a 
single data structure, to minimize the number of 
registers required. Offsets into the structure point 
to the beginning of each separately multiplied im- 
age. As shown in Figure 17, data structure 1700 
comprises pixel values of the resultant image multi- 
plied by 1 (1510), pixel values of the resultant 
image multiplied by 6 (1610), pixel values of the 
resultant image multiplied by 15 (1620), and the 
pixel values of the resultant image multiplied by 20 
(1630). 

The second step of the y-axis Gaussian con- 
volution is similar to the second step of the x-axis 
Gaussian convolution, except that pixel values of 
the resultant image data structure are summed to 
generate values for pixels of the registration image 
and the selected pixel values of the data structure 
to be summed are offset in the y-direction from the 
corresponding pixel location of the registration im- 
age. 

The second step of the x-axis Gaussian con- 
volution is illustrated in Figure 17. In this step, the 
value for a given pixel location 1720 of the resultant 
image is determined by adding together: 

o the values of two pixels 1725 and 1730 from 
resultant image 1510, the locations of pixels 
1725 and 1730 being offset in the y-direction 
by three pixel locations from the pixel loca- 
tion of resultant image 1510 which corre- 
sponds to pixel location 1720, and 
o the values of two pixels 1735 and 1740 from 
the six-multiplier image 1610, the locations of 
pixels 1735 and 1740 being offset in the y- 
direction by two pixel locations from the pixel 
location of the 6-multiplier image 1610 which 
corresponds to pixel location 1720, and 
o the values of two pixels 1745 and 1750 from 
the fifteen-multiplier image 1620, the loca- 
tions of pixels 1745 and 1750 being offset in 
the y-direction by one pixel location from the 
pixel location of the 15-multiplier image 1420 
which corresponds to pixel location 1720, and 
o the value of a pixel 1760 from the twenty- 
multiplier image 1630, the location of pixel 
1760 corresponding to pixel location 1720. 
The sums are completed to produce a value for 
each pixel of registration image 1710, so that reg- 
istration image 1710 represents the convolution of 



resultant image 1510 with the y-axis Gaussian ker- 
nel. 

Figure 18A again shows layout image patch 
710. Figure 18B shows a registration image 1810 
5 produced by convolving layout image patch 710 
with the Laplacian and Gaussian operators in the 
manner just described. Comparison of Figures 18A 
and 18B shows that edges and corners of the 
layout image patch are smoothed by convolution 
io processing. 

Figure 19A again shows SEM image patch 810. 
Figure 19B shows a registration image 1910 pro- 
duced by convolving SEM image patch 810 with 
the Laplacian and Gaussian operators in the man- 
75 ner just described, and further convolving with a 
second Gaussian kernel 2000 having sparse oper- 
ators, illustrated in Figure 20. The first Gaussian 
convolution (using the kernel of Figure 12) smooths 
high-frequency shot noise and prevents aliasing. 
20 The second Gaussian convolution eliminates volt- 
age-contrast beating patterns in the SEM image 
patch. Voltage contrast is the difference in image 
brightness caused by different voltage potentials on 
features of the integrated circuit device being im- 
25 aged with the SEM. The second Gaussian convolu- 
tion is carried out in the manner described above, 
but the use of zeros between each coefficient (Fig- 
ure 20) changes the Gaussian-kernel spread from 
seven pixels to thirteen pixels in each of the x- and 
30 y-directions. This increases effective kernel size, 
smoothing higher-frequency patterns such as the 
voltage contrast beating pattern. Comparison of 
Figures 19A and 19B shows that features of the 
SEM image are enhanced and noise visible in 
35 Figure 1 1 B is smoothed. 

Those of skill in the art will recognize that the 
second Gaussian convolution is not required in all 
cases. For example, a single Gaussian convolution 
is adequate for processing layout patch 710 as 
40 described. Other Gaussian kernels may be used as 
appropriatege being processed. 

This completes preparation of the registration 
images. Layout registration image 1810 serves as a 
first registration image for autocorrelation, and SEM 
45 registration image 1910 serves as a second reg- 
istration image for autocorrelation. 

Autocorrelation 

so Autocorrelation of registration images 1810 and 

1910 is performed to determine the x-axis and y- 
axis offset required to best match one image 
against another. Matching on the sign-representa- 
tion of the convolution increases stability and 

55 makes the matching process much more tolerant of 
noise. Simply stated, rather than matching points 
where the Gaussian-smoothed Laplacian images 
cross zero, the positive areas of a first registration 
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image are matched with the positive areas of a 
second registration image, and the negative areas 
of the first registration image are matched with the 
negative areas of the second registration image. 
For this purpose, the registration images are 
binarized on the sign of the convolution before 
correlation. That is, each pixel of a registration 
image is assigned a binary value (zero or one) 
defending on the sign (positive or negative) of the 
pixel value. The autocorrelation uses the exclusive- 
OR- (EXOR) function to match pixels of like sign 
(positive or negative) in a pixel-by-pixel operation. 

* Figure 21 shows various images juxtaposed to 
illustrate the autocorrelation objective. A CAD lay- 
out image patch (a) is convolved as described 
above to create a layout registration image (b) of 
178 x 178 pixels, and binarized. A SEM image 
patch (c) is convolved as described above to cre- 
ate a SEM registration image (d) of 128 x 128 
pixels, and binarized. Image (b) is used as the 
search area. Image (d) is used as a moving patch. 
The autocorrelation process finds a relative x-y 
offset position between the images at which image 
(d) best matches image (b). 

Autocorrelation begins by aligning the upper- 
left pixel of SEM registration image (d) with the 
upper left pixel of layout registration (b) so that the 
128x128 pixel locations of image (d) are aligned 
respectively with the upper-left 128x128 pixel loca- 
tions of image (b). For each of the 128x128 pixel 
locations, an EXOR between the binarized intensity 
values of image (d) and image (b) is performed. 
The resulting 128x128 binary (pixel-correlation) val- 
ues are summed and the sum is taken as an 
image-correlation value for that relative offset posi- 
tion of images (d) and (b). Image (d) is then shifted 
relative to image (b) by one pixel location, the 
EXOR is performed, and the sum of the EXORed 
pixels is taken as a correlation value for this new 
relative offset position. The process is repeated to 
produce a correlation value preferably for each 
possible position of SEM registration image (d) 
relative to layout registration image (b). 

The significance of the correlation values can 
be seen from Figure 22A, in which the correlation 
values for all possible offset positions of image (d) 
to image (b) are mapped to produce an autocor- 
relation surface. The highest peak (correlation peak 
2200) of the autocorrelation surface represents a 
relative x-y offset between the images at which the 
two images are best matched. 

Image (e) of Figure 21 is a patch from image 
(b) which has been found to best match image (d). 
Image (e) is shown to the right of image (d) to 
show alignment of horizontal matching features. 
Image (g) is the same as image (e) and is shown 
below image (d) to show alignment of vertical 
matching features. Figure 22B shows the autocor- 



relation values along the x-axis of an x-z plane 
intersecting correlation peak 2200. Figure 22C 
shows the autocorrelation values along the y-axis of 
a plurality of y-z planes, including a y-z plane 

5 intersecting correlation peak 2200. False correlation 
peaks can be seen at 2210, 2220 and 2230. 

In this example using a 178x178 search area 
and a 128x128 moving patch, offset of the images 
is determined to within ± 25 pixels on the x-axis 

10 and to within ± 25 pixels on the y-axis. Performing 
autocorrelation in the manner just described re- 
quires 42,614,784 (128x128x51x51) iterations to 
complete. 

76 Optimizing the Autocorrelation 

Significant time can be saved by preparing the 
first registration image (e.g., by convolving and bit- 
packing layout image patch 710) while the stage is 

20 moving to its best approximation of alignment. (Fig- 
ure 5, step 500.) Additional time saving can be 
obtained by optimizing the autocorrelation as will 
now be described. 

A microprocessor preferred for carrying out 

25 methods of the invention has 32-bit word size. The 
data required for a registration image comprises, 
for example, 128x128 words of 32-bits per word. 
When the registration image is binarized on the 
sign of the convolution, each binarized intensity 

30 value can be represented as one bit of a 32-bit 
word. This is known as bit-packing, illustrated in 
Figure 23. The 128x128x32 bits of data 2300 de- 
scribing the registration image are thus bit-packed 
to a size of 128x4x32 bits of data 2310. With the 

35 data bit-packed, 32 EXORed pixel operations of the 
autocorrelation can be performed in a single micro- 
processor instruction. The result of the EXOR op- 
eration is a 32-bit word. A table lookup is then used 
to determine the number of bits matched. 

40 Using a serial microprocessor in this parallel 

fashion reduces the number of iterations for auto- 
correlation of a 128x128 moving patch with a 
178x178 image from 42,614,784 (1 28x1 28x51 x51 )to 
1,331,712 (128x4x51x51). 

45 Further time is saved by reducing the number 

of bit-wise shift operations. For this purpose, a 
separate bit-shifted image strip is extracted from 
the larger binarized registration image for each 
possible offset in either the x- or y- direction. For 

so example, to autocorrelate a 128x128 moving patch 
with a 178x178 image, a strip of 128x178 pixels 
from the 178x178 image is extracted for each pos- 
sible offset along the x-axis. Figure 24 illustrates 
four such strips, 2410, 2420, 2430, 2440, extracted 

55 from a registration image 2400. To determine offset 
within ± 25 pixel locations, 51 such image strips 
bit-shifted along the x-axis are generated. The 
memory required to store these image strips is 
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reasonable because they are bit-packed. With judi- 
cious selection of the moving patch size as in this 
example, the data describing the image strips falls 
on 32-bit boundaries so that bit-shifting for verti- 
cally-shifted images is not required. 5 

Attention is again directed to the probe-beam 
placement example of Figure 5. If the optimized 
autocorrelation is used in determining offset of a 
SEM image to a layout image, the stage motors 
are checked when preparation of the bit-shifted io 
layout image strips is complete. If the motors are 
still moving the stage to the new coordinates, the 
registration process waits. When stage motion is 
complete (Figure 5, step 520), the SEM image is 
acquired and used to prepare the moving patch. 75 

After preparation of the image strips and the 
moving patch, optimized autocorrelation is carried 
out as illustrated in Figure 25. The moving patch 
2500 is correlated with the first image strip at a first 
position (e.g., y-offset equals zero) by performing 20 
the EXOR function for the entire overlap region of 
128x128 pixels in a single microprocessor opera- 
tion. The result of the EXOR operation is used to 
determine a correlation value for this offset (x = 0, 
y = 0). The SEM registration image is shifted down 25 
one row (e.g.. y-offset equals 1 pixel), the EXOR 
function is performed, and a correlation value is 
determined for this offset (0,1). The sequence is 
repeated for each of the 51 possible y-offsets of 
each of the 51 image strips. Autocorrelation per- 30 
formed in this fashion benefits from the speed of 
bit-packing but eliminates the need to perform bit- 
shifting operations during autocorrelation. The im- 
age strip producing the best match with the moving 
patch determines the offset of the SEM image 35 
relative to the layout image along the x-axis. The 
best match along the length of that image strip 
determines the offset along the y-axis. This op- 
timized autocorrelation process produces the same 
correlation values as are shown in Figures 22A- 40 
22C, and is efficiently carried out using a general- 
purpose microprocessor. 

Interpretation 

45 

One measure of the autocorrelation is the cor- 
relation coefficient. Referring to Figure 22A, the 
correlation coefficient is the relationship of the 
height of correlation peak 2200 to the correlation 
surface. High correlation coefficients have been 50 
obtained in matching a SEM image to another SEM 
image in accordance with the invention. Correlation 
coefficients obtained in matching a SEM image to 
a CAD layout image tend to be lower, due to 
voltage contrast and the absence of buried-conduc- 55 
tor edges. For example, vertical rectangular areas 
730 and 735 (power and ground planes of the IC) 
shown in the layout image of Figure 7 are not 



visible in the corresponding SEM image of Figure 
8. Also, missing in the convolved SEM image of 
Figure 19B are the two central horizontal conduc- 
tors 740 and 745 shown in the layout image of 
Figure 7. Such features are treated as noise in the 
image; as long as enough of the image is intact, a 
correct match is made. 

Another problem incurred in matching these 
type images arises from the repetitive horizontal 
and vertical features. The correlation surface shown 
in Figure 22B shows false peaks 2210, 2220 and 
2230. These are due to the partial matching of 
different vertical conductors. Further characteriza- 
tion of the correlation surface generated by a mis- 
match is shown in Figure 22B. The difference be- 
tween the correlation coefficient (z-axis value) of 
correlation peak 2200 and that of the next highest 
peak 2210 determines a peak-to-peak threshold, 
shown by dashed line 2240. The base threshold of 
false peak 2200 is shown by dashed line 2250, and 
the base threshold of correlation peak 2000 is 
shown by dashed line 2260. The peak-to-peak 
threshold, and the mass of each of the peaks, can 
be used to determine "goodness" of the registra- 
tion. 

Autocorrelation can also be enhanced by an 
understanding of the IC device's manufacturing 
process. Referring again to Figure 21, image (f) 
shows an overlay of SEM registration image (d) 
and layout registration image patch (e). The gray 
areas between the black and white are due to 
feature size differences. Image (h) of Figure 21 
shows an overlay of SEM registration image (d) 
and layout registration image patch (e), with match- 
ing pixels shown in white and mismatching pixels 
shown in black. The outlines of specific features 
are evident in image (h). This is due to variations of 
line width resulting from the semiconductor manu- 
facturing process. 

Applications 

Those of skill in the art will recognize that the 
methods of the invention will find many applica- 
tions in connection with charged-particle beam sys- 
tems employing general-purpose processors, in- 
cluding the Schlumberger "IDS 5000™ " and "IDS 
7000 FIBstation™ " systems. Relative image offsets 
are determined without addition of specialized pro- 
cessing hardware, allowing automation of oper- 
ations previously requiring repeated human inter- 
vention. Without limiting the scope of the invention 
as defined by the claims, a few such applications 
are as follows. 
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1. Backtracking a failing IC (offset of SEM image to 
layout image) 

The probe-beam placement method described 
with reference to Figure 5 can be used to advan- 5 
tage in backtracing a failing IC to location the origin 
of a failure. 

- In conventional backtracing with an E-beam 
system, a failing output pin of a device is identified, 
e.gft* by exercising the device and detecting an 10 
unexpected signal at the failing output pin. The 
user, or an automated diagnostic software package, 
them recommends an IC node to probe with a 
beam. Measured information at this node is used to 
make a decision about successive places to ac- 75 
quire measurements. Back-tracing through the cir- 
cuit by making successive measurements can 
eventually lead to a probe location where mea- 
sured data matches expected data, leading to a 
conclusion about the location of a failing element in 20 
the IC. Each time a net is selected for probing, the 
system uses the linked schematic/layout data to 
map the net to a specific place on a specific 
conductor of the IC. A window/probe locator pro- 
gram, considering conductor width, exposure and 25 
crosstalk, determines the best place to probe as an 
x.y coordinate in the CAD layout data. A cor- 
responding field-of-view and probe location are de- 
termined and the probe beam is positioned accord- 
ingly. With the prior-art systems, stage alignment 30 
errors and field effects can demand operator inter- 
vention to assure accurate placement of the probe 
beam at each probe location. Without accurate 
placement of the probe beam, measurements 
made by the diagnostic process may not be valid. 35 
Avoiding the need for such repeated operator inter- 
vention in accordance with the invention can save 
substantial time and cost. 

2. IC-fault difference imaging (offset of SEM image 40 
to SEM image) 

Determining image offset in accordance with 
the invention can be used to automate IC fault 
detection, as illustrated in Figure 26. 45 

In accordance with a prior-art technique, a 
charged-particle beam imaging system such as a 
SEM is used to acquire a series (a "stack" 2600) of 
voltage-contrast images of a known good IC taken 
at a fixed field of view. Each image is taken at a so 
discrete time during application of a cyclical test 
pattern to the IC. A similar "stack" 2610 of voltage 
contrast images of a failing IC is taken at approxi- 
mately the same fixed field of view and at the 
same discrete times in the test pattern cycle. A 55 
stack of difference images is then prepared, each 
representing the difference at a given time in the 
cycle between an image of the "good" stack and a 
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corresponding image of the "failing" stack. Be- 
cause voltages on the conductors change potential 
over time during the test cycle, the location and 
time in the cycle at which a failure occurs is readily 
identified by examining the "difference" stack. As 
the difference image is prepared by subtracting 
intensity values of the images pixel-by-pixel, the 
images must be properly aligned. In the past, as- 
suring alignment has required considerable human 
intervention. 

In accordance with the invention, the offset 
between a reference image 2620 of the good stack 
and a corresponding reference image 2630 of the 
failing stack is determined. That is, each of images 
2620 and 2630 is retrieved, convolved and bit- 
packed as a binarized image. The binarized images 
are autocorrelated to determine the offset. Images 
2620 and 2630 are then registered to one another 
using the determined offset, and a first difference 
image is prepared. If all images of the good stack 
are taken at a fixed field of view and all images of 
the failing stack are taken at a fixed field of view, 
the offset determined for the first image 2620 and 
corresponding image 2630 can be used to register 
each image of the good stack to a corresponding 
image of the failing stack. For optimum determina- 
tion of offset in accordance with the invention, the 
reference images of the good stack and of the 
failing stack are acquired before or after (not dur- 
ing) application of the test pattern to the IC. 

3. Batch IC repair (offset of live SIM image to 
stored SIM image) 

FIB systems are commonly used to repair IC 
devices by cutting and/or depositing material at 
selected locations. It is often desired to make the 
same repair on each of a batch of IC devices. The 
repair process can be automated for an entire IC 
batch in accordance with the invention, as illus- 
trated in Figure 27. 

For example, a first IC device is placed in a 
FIB system. A SIM image is acquired over a field 
of view which includes a selected region where a 
first operation is to be performed, and parameters 
of the operation are defined, such as beam power, 
milling time, boundaries of the selected region, etc. 
(step 2710). The parameters are recorded, along 
with stage coordinates for that field of view and the 
SIM image (step 2720). These steps are repeated 
for each of the desired operations (step 2725). The 
result is a recorded "script" for controlling the FIB 
system to carry out the operations, the script in- 
cluding at least one SIM reference image of the 
device for each stage position. The script can be 
recorded while repair operations are being carried 
out on a first device of the batch, and the effective- 
ness of the repair verified before processing other 
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devices of the batch. 

The script can then be used to control the FIB 
system for automatically repairing another device 
of the batch. Each time the stage is moved to a 
new coordinate location, the corresponding SIM 5 
reference image is retrieved, convolved and bit- 
packed to produce a binarized first image (step 
2730). When the stage stops (step 2740), a live 
SIM image of the device is acquired, convolved 
and bit-packed to produce a binarized second im- 10 
age (step 2750). The binarized first and second 
images are autocorrelated to determine offset be- 
tween the SIM reference image and the live SIM 
image (step 2760). The determined offset is then 
used as a correction in positioning the FIB relative 15 
to the device (step 2770) when carrying out the 
scripted operation. Variables such as stage posi- 
tioning error and field effects are thus automatically 
compensated. The FIB mill/deposit operation is 
then performed as scripted (step 2780). Steps 20 
2730-2780 can be repeated for any number of 
scripted operations (step 2790). 

4. Auto-calibration of charged-particle beam sys- 
tems (offset of SEM image to SEM image or SIM 25 
image to SIM image) 

Determining offset between images can be 
used in calibration of E-beam and FIB systems. For 
example, different beam currents are used in var- 30 
ious FIB operations. In general, higher beam cur- 
rents are used for milling in order to remove ma- 
terial at a fast rate, while lower beam currents are 
used for imaging in order to obtain higher resolu- 
tion images. A slight image offset typically results 35 
when beam current is changed, which can result 
for example in milling an area somewhat offset 
from the desired area to be milled. 

Figure 28 illustrates a method for calibrating 
the image offset when beam current is changed 40 
between a relatively low beam current (e.g., 50 pA) 
and a relatively high beam current (e.g., 200 pA). A 
first image 2810 is acquired at a first beam current 
(e.g., a low current) and the image or a patch of the 
image is processed as a search area, i.e., to pre- 45 
pare a first registration image as described above 
(step 2815). When the beam current is changed to 
a second level (e.g., a high current), a second 
image 2820 is acquired and the image or a patch 
of the image is processed to prepare a second 50 
registration image (step 2825). The first and sec- 
ond registration images are autocorrelated and the 
offset between the images is determined as de- 
scribed above (step 2830). The determined offset 
can be stored in memory and used to offset the 55 
beam scan each time the beam current is switched 
between the two values (step 2835), or the offset 
can be determined anew each time the beam cur- 



rent is switched. The technique can likewise be 
used to calibrate offset between images for other 
variable system parameters, such as beam scan- 
ning offset or stage motion offset. 

5. Long-duration waveform acquisition (offset of 
SEM image to SEM image) 

E-beam systems are commonly used not only 
to acquire a SEM image of a device but also to 
acquire a waveform on a conductor of the device. 
Image acquisition and waveform acquisition are 
multiplexed — the image is acquired by scanning 
the beam over a region of the device during first 
repetitive time intervals and the waveform is ac- 
quired by directing the beam at a probe location on 
the conductor of interest during second repetitive 
time intervals alternating with the first time inter- 
vals. Acquisition of a long waveform (e.g., > 2 
seconds) can be incomplete or inaccurate because 
the beam tends to drift from the intended probe 
location due to changes in the filament of the 
electron gun and/or other causes. 

It is possible in accordance with the invention 
to correct for beam drift to assure complete and 
accurate acquisition of a long waveform. From time 
to time during acquisition of the waveform, a SEM 
image is acquired, offset between the latest SEM 
image and a previous SEM image is determined, 
and the probe beam positioning is adjusted using 
the determined offset. For example, to acquire a 
long waveform: 

a. Establish initial coordinates for the intended 
probe location, e.g., by placing a probe icon in 
the center of a conductor appearing in a dis- 
played SEM image of the device, 

b. Acquire a reference SEM image which in- 
cludes the probe location, 

c. Begin waveform acquisition by directing the 
probe beam using the initial coordinates of the 
probe location, 

d. Multiplex SEM image acquisition with 
waveform acquisition to acquire an updated 
SEM image, 

e. Determine offset between the updated SEM 
image and the reference SEM image by con- 
volving and autocorrelating the images, 

f. Prepare updated coordinates for the probe 
location by adjusting the initial coordinates using 
the determined offset, 

g. Continue waveform acquisition by directing 
the probe beam using the updated coordinates 
of the probe location, and 

h. If desired, repeating steps d. through g. from 
time to time until waveform acquisition is com- 
plete. 

Figure 29 illustrates a preferred method of 
long-duration waveform acquisition. A SEM image 
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2910 of a portion of an IC is acquired and a probe 
icon 2905 is placed on the image. A patch of the 
first image is processed as a first registration im- 
age to be used as a search area (step 2915). After 
performing waveform acquisition for some period of 5 
time, a second SEM image 2920 is acquired and 
processed as a second registration image to be 
used as a moving patch (step 2925). The first and 
second registration images are autocorrelated and 
a ptfobe offset is determined (step 2930). The de- io 
termined offset is used to reposition the probe to 
compensate for beam drift (step 2935). Probe posi- 
tioning can be updated from time to time by deter- 
mining a new offset using a newly-acquired second 
image. 75 

The foregoing description of preferred embodi- 
ments of the invention is intended as illustrative 
only, and not as a limitation of the invention as 
defined by the claims which follow. Those of skill in 
the art will recognize many modifications which 20 
may be made in the preferred embodiments within 
the spirit and scope of the claimed invention. 

For most FIB operations, high magnification is 
chosen due to the need for accurate alignment of 
the beam with the device structure to be milled. If 25 
desired, one may begin with relatively lower mag- 
nification, determine offset (e.g.. between a layout 
image on which is marked the area to be milled 
and a SEM image of the device), then change to 
higher magnification and determine offset once 30 
again. 

Claims 

1. A method of operating a processor to deter- 35 
mine offset of a second image relative to a first 
image, wherein each image is defined by 
stored pixel data describing a respective plu- 
rality of pixels in which each pixel is defined 
by a location within an x-y grid and an inten- 40 
sity value, comprising the steps of: 

a. retrieving from said stored pixel data a 
set of data describing a first patch (710) 
comprising nxn pixels from a first image 
(700); 45 

b. preparing data defining a first Laplacian 
patch (1010) by convolving intensity values 
of pixels of the first patch with values of a 
zero-mean Laplacian kernel (900), the data 
defining the first Laplacian patch describing 50 
a plurality of pixels in which each pixel is 
defined by a location within an x-y grid and 

an intensity value having a sign; 

c. preparing data defining a first registration 
image (1810) by convolving intensity values 55 
of pixels of the first Laplacian patch with a 
Gaussian kernel (1200) along two axes of an 

x-y grid, the Gaussian kernel having a plu- 



rality of Gaussian kernel values (e.g., 1, 6, 
15, 20) which can be arranged to approxi- 
mate a Gaussian sequence (e.g., 1, 6, 15, 
20, 15, 6, 1), the data defining the first 
registration image describing a plurality of 
pixels (e.g., 1720) in which each pixel is 
defined by a location within an x-y grid and 
an intensity value having a sign; 

d. preparing data defining a first binarized 
image by converting intensity values of pix- 
els of the first registration image to respec- 
tive binary values in dependence upon the 
sign of the intensity value, the data defining 
the first binarized image describing a plural- 
ity of pixel locations within an x-y grid and a 
binary value for each pixel location; 

e. retrieving from said stored pixel data a 
set of data describing a second patch (810) 
of mxm pixels from a second image (800). 
where m is a value less than n; 

f. preparing data defining a second 
Laplacian patch (1110) by convolving inten- 
sity values of pixels of the second patch 
with values of a zero-mean Laplacian kernel 
(900). the data defining the second 
Laplacian patch describing a plurality of pix- 
els in which each pixel is defined by a 
location within an x-y grid and an intensity 
value having a sign; 

g. preparing data defining a second reg- 
istration image (1910) by convolving inten- 
sity values of pixels of the second Laplacian 
patch with a Gaussian kernel (1200) along 
two axes of an x-y grid, the Gaussian kernel 
having a plurality of Gaussian kernel values 
(e.g., 1,6,15, 20) which can be arranged to 
approximate a Gaussian sequence (e.g., 1, 
6, 15, 20, 15, 6, 1), the data defining the 
second registration image describing a plu- 
rality of pixels in which each pixel is defined 
by a location within an x-y grid and an 
intensity value having a sign; 

h. preparing data defining a second binariz- 
ed image by converting intensity values of 
pixels of the second registration image to 
respective binary values in dependence 
upon the sign of the intensity value, the 
data defining the second binarized image 
describing a plurality of pixel locations with- 
in an x-y grid and a binary value for each 
pixel location; 

i. for each of a plurality of possible offset of 
the second binarized image relative to the 
first binarized image for which mxm pixels 
of the second binarized image are aligned 
with mxm pixels of the first binarized image, 

(1) performing an EXOR operation for 
each of mxm pixel locations between the 
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binary value of the binarized first reg- 
istration image and the binary value of 
the binarized second registration image 
to produce a binary pixel-correlation val- 
ue per pixel location; and 5 
(2) determining a sum of the binary pixel- 
correlation values to obtain an image- 
correlation value; and 
j. comparing the image-correlation values to 
identify an offset of the second binarized io 
image relative to the first binarized image 
which results in a maximum correlation be- 
tween the second binarized image and the 
first binarized image; and 

k. storing a representation of the identified 15 
offset, said stored representation being indi- 
cative of offset of the second image relative 
to the first image. 

2. The method of claim 1, wherein step c. com- 20 
prises the steps of: 

(1) for each Gaussian kernel value, multiply- 
ing the intensity values of the first Laplacian 
patch by the Gaussian kernel value to pre- 
pare data defining a respective first multi- 25 
plier image (e.g., 1400. 1410. 1420. 1430), 
such that the data defining a first multiplier 
image for a given Gaussian kernel value 
describes a plurality of pixels in which each 
pixel is defined by a location in an x-y grid 30 
and an intensity value comprising the prod- 
uct of the given Gaussian kernel value and 

a corresponding intensity value of the first 
Laplacian patch; 

(2) summing intensity values selected from 35 
pixels (e.g., 1525 - 1560) of said first multi- 
plier images to prepare data defining a first 
resultant image (1510) such that the first 
resultant image approximates a convolution 

of the first Laplacian image with the Gaus- 40 
sian kernel along one of said axes (e.g., the 
x-axis), the data defining the first resultant 
image describing a plurality of pixels (e.g., 
1520) in which each pixel is defined by a 
location within an x-y grid and an intensity 45 
value; 

(3) for each Gaussian kernel value, multiply- 
ing the intensity values of the first resultant 
image by the Gaussian kernel value to pre- 
pare data defining a respective second mul- 50 
tiplier image (e.g., 1510, 1610, 1620, 1630), 
such that the data defining a second multi- 
plier image for a given Gaussian kernel val- 
ue describes a plurality of pixels in which 
each pixel is defined by a location in an x-y 55 
grid and an intensity value comprising the 
product of the given Gaussian kernel value 

and a corresponding intensity value of the 



first resultant image; and 
(4) summing intensity values selected from 
pixels (e.g., 1725 - 1760) of said second 
multiplier images to prepare the data defin- 
ing the first registration image (1810) such 
that the first registration image approxi- 
mates a convolution of the first resultant 
image with the Gaussian kernel along the 
other of said axes (e.g., the y-axis). 

3. The method of claim 2, wherein each pixel of 
the first Laplacian patch has an intensity value 
<? , and wherein step c.(1) comprises for each 
pixel of the first Laplacian patch: 

(a) storing in a first register a binary number 
representing the intensity value of the 
pixel, 

(b) left-shifting the binary number stored in 
the first register to produce a binary number 
representing a value 2 and storing said 
binary number representing value 2 in a 
second register, 

(c) left-shifting the binary number stored in 
the second register to produce a binary 
number representing a value 4 and stor- 
ing said binary number representing value 4 
1? in a third register. 

(d) left-shifting the binary number stored in 
the third register to produce a binary num- 
ber representing a value 16 <? and storing 
said binary number representing value 16 
in a fourth register, 

(e) summing the binary numbers stored in 
said second and third registers to produce a 
binary number representing a value 6 <5 and 
storing said binary number representing val- 
ue 6 in a fifth register, 

(f) subtracting the binary number stored in 
said first register from the binary number 
stored in said fourth register to produce a 
binary number representing a value 15 # 
and storing said binary number representing 
value 15 in a sixth register, 

(g) summing the binary numbers stored in 
said third and fourth registers to produce a 
binary number representing a value 20 
and storing said binary number representing 
value 20 in a seventh register, and 

(h) storing the binary numbers representing 
values , 6 <? , 15 and 20 in a data 
structure, 

such that, when steps c.i.(a) through c.i.(h) are 
completed for each pixel of the first Laplacian 
patch, the data structure contains data describ- 
ing a first multiplier image for each Gaussian 
kernel value. 

4. The method of claim 1 , wherein: 
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step c. further comprises storing the data 
defining the first registration image as a 
series of 2 p -bit digital words in which each 
digital word contains an intensity value of a 
respective pixel of the first registration im- 5 
age, and wherein step d. further comprises 
the step of storing said binary values of the 
data defining the first binarized image as a 
single 2 p -bit digital word for each 2 P pixels 
of the first binarized image; w 
step g. further comprises storing the data 
defining the second registration image as a 
series of 2 p -bit digital words in which each 
digital word contains an intensity value of a 
respective pixel of the second registration is 
image, and wherein step d. further com- 
prises the step of storing said binary values 
of the data defining the second binarized 
image as a single 2 p -bit digital word for 
each 2 p pixels of the second binarized im- 20 
age; 

step i.(1) comprises, for each block of 2 P 
pixel locations, performing an EXOR op- 
eration for each of the 2 P pixel locations 
in a single processor instruction to there- 25 
by produce a digital matching word re- 
presenting correlation of the first binariz- 
ed image and the second binarized im- 
age over the 2 P pixel locations; and 
-* step i.(2) comprises, for each block of 2 P 30 
pixel locations, looking up the digital 
matching word in a stored look-up table 
in which a sum of binary correlation val- 
ues of 2 P pixel locations is provided for 
each possible value of the digital match- 35 
ing word to thereby obtain a partial-cor- 
relation value representing the sum of 
binary correlation values for 2 P pixel lo- 
cations, and summing partial-correlation 
values of all of said blocks of 2 P pixel 40 
locations to obtain said image-correlation 
value. 

5. The method of claim 1, wherein said possible 

offsets comprise a first plurality of possible 45 
offsets along the x-axis and a second plurality 
of possible offsets along the y-axis, the meth- 
od further comprising the step of: 
preparing from said data defining a first 
binarized image, for each possible offset along 50 
the x-axis, data defining a strip of nxm pixel 
locations of the first binarized image, and 
wherein step i.(1) comprises, for each said 
strip of nxm pixel locations of the first binariz- 
ed image and for each possible offset along 55 
the y-axis, performing an EXOR operation for 
each of nxn pixel locations between the binary 
value of the first binarized image and the bi- 



nary value of the second binarized image. 

6. The method of claim 1, wherein said second 
image comprises a CAD layout image of an IC 
and said first image comprises a SEM image 
of an IC, and wherein step g. further comprises 
preparing data defining a second registration 
image by convolving intensity values of pixels 
of the second Laplacian patch with a plurality 
of Gaussian kernels. 

7. The method of claim 1, wherein said first im- 
age comprises a layout image of an IC and 
said second image comprises a SEM image of 
an IC device, the method further comprising 
the steps of selecting from said first image a 
first x-y coordinate representing a selected lo- 
cation of said IC device at which a probe beam 
is to be placed, preparing a second x-y coordi- 
nate shifted from said first x-y coordinate by 
said identified offset, aiming an electron-beam 
at the IC device in a direction corresponding to 
said second x-y coordinate, detecting secon- 
dary electrons emitted from the IC as the elec- 
tron beam is aimed at said IC device during a 
first time interval to thereby acquire a first 
portion of a waveform appearing at the se- 
lected location of the IC device, acquiring an 
updated SEM image of the IC, replacing said 
second image with said updated SEM image, 
repeating steps a. through k. to identify an 
updated offset, preparing an updated second 
x-y coordinate shifted from said first x-y co- 
ordinate by said updated offset, aiming the 
electron-beam during a second time interval at 
the IC device in a direction corresponding to 
the updated second x-y coordinate, and de- 
tecting secondary electrons emitted from the 
IC as the electron beam is aimed at said IC 
device during the second time interval to 
thereby acquire a second portion of a 
waveform appearing at the selected location of 
the IC device. 

8. The method of claim 1, wherein said first im- 
age comprises a SEM reference image of a 
first stack of images representing correct op- 
eration of an IC device and said second image 
comprises a SEM reference image of a second 
stack of images representing failing operation 
of an IC device and each image of the second 
stack corresponds to an image of the first 
stack, the method further comprising the steps 
of shifting each image of the second stack 
relative to the corresponding image of the first 
stack by an amount equal to the identified 
offset and, for each image of the first stack, 
preparing a difference image by taking the 
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difference between the intensity values of pix- 
els of image of the first stack and the intensity 
values of pixels of the shifted image of the 
second stack. 

5 

9. The method of claim 1, wherein said first im- 
age comprises a SIM image of a first IC device 
and said second image comprises a SIM im- 
age of a second IC device, the method further 
comprising the steps of selecting from said io 
first image a first x-y coordinate representing a 
location of said second IC device at which a 

FIB is to be directed, preparing a second x-y 
coordinate shifted from said first x-y coordinate 
by said identified offset, and aiming a FIB at 75 
the second IC device in a direction corre- 
sponding to said second x-y coordinate. 

10. Apparatus for determining offset of a second 
image relative to a first image, comprising: 20 

a. means for storing the first image (700) 
and the second image (800) as pixel data 
describing a respective plurality of pixels in 
which each pixel is defined by a location 
within an x-y grid and an intensity value; 25 

b. means for retrieving from said storing 
means a set of data describing a first patch 
(710) comprising nxn pixels of the first im- 
age; 

c. means for preparing data defining a first 30 
Laplacian patch (1010) by convolving inten- 
sity values of pixels of the first patch with 
values of a zero-mean Laplacian kernel 
(900), the data defining the first Laplacian 
patch describing a plurality of pixels in 35 
which each pixel is defined by a location 
within an x-y grid and an intensity value 
having a sign; 

d. means for preparing data defining a first 
registration image (1810) by convolving in- 40 
tensity values of pixels of the first Laplacian 
patch with a Gaussian kernel (1200) along 

two axes of an x-y grid, the Gaussian kernel 
having a plurality of Gaussian kernel values 
(e.g., 1,6, 15, 20) which can be arranged to 45 
approximate a Gaussian sequence (e.g., 1, 
6. 15, 20, 15, 6, 1), the data defining the 
first registration image describing a plurality 
of pixels (e.g., 1720) in which each pixel is 
defined by a location within a x-y grid and so 
an intensity value having a sign; 

e. means for preparing data defining a first 
binarized image by converting intensity val- 
ues of pixels of the first registration image 

to respective binary values in dependence 55 
upon the sign of the intensity value, the 
data defining the first binarized image de- 
scribing a plurality of pixel locations within 



an x-y grid and a binary value for each pixel 
location; 

f. means for retrieving from said stored pixel 
data a set of data describing a second 
patch (810) of mxm pixels from the second 
image, where m is a value less than n; 

g. means for preparing data defining a sec- 
ond Laplacian patch (1110) by convolving 
intensity values of pixels of the second 
patch with values of a zero-mean Laplacian 
kernel (900), the data defining the second 
Laplacian patch describing a plurality of pix- 
els in which each pixel is defined by a 
location within an x-y grid and an intensity 
value having a sign; 

h. means for preparing data defining a sec- 
ond registration image (1910) by convolving 
intensity values of pixels of the second 
Laplacian patch with a Gaussian kernel 
(1200) along two axes of an x-y grid, the 
Gaussian kernel having a plurality of Gaus- 
sian kernel values (e.g., 1, 6, 15, 20) which 
can be arranged to approximate a Gaussian 
sequence (e.g.. 1, 6, 15. 20, 15. 6. 1), the 
data defining the second registration image 
describing a plurality of pixels in which each 
pixel is defined by a location within an x-y 
grid and an intensity value having a sign; 

i. means for preparing data defining a sec- 
ond binarized image by converting intensity 
values of pixels of the second registration 
image to respective binary values in depen- 
dence upon the sign of the intensity value, 
the data defining the second binarized im- 
age describing a plurality of pixel locations 
within an x-y grid and a binary value for 
each pixel location; 

j. means for performing, for each of a plural- 
ity of possible offsets of the second binariz- 
ed image relative to the first binarized im- 
age for which mxm pixels of the second 
binarized image are aligned with mxm pix- 
els of the first binarized image, an EXOR 
operation for each of mxm pixel locations 
between the binary value of the binarized 
first registration image and the binary value 
of the binarized second registration image 
to produce a binary pixel-correlation value 
per pixel location; 

k. means for determining, for each of the 
possible offsets of the second binarized im- 
age relative to the first binarized image for 
which mxm pixels of the second binarized 
image are aligned with mxm pixels of the 
first binarized image, a sum of the binary 
pixel-correlation values to obtain an image- 
correlation value; 
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I. means for comparing the image-correla- 
tion values to identify an offset of the sec- 
ond binarized image relative to the first 
binarized image which results in a maxi- 
mum correlation between the second 5 
binarized image and the first binarized im- 
age; and 

k. means for storing a representation of the 
set identified offset, said stored representation 

being indicative of offset of the second im- io 
\ age relative to the first image. 

11. -A method of modidying an IC device, compris- 
ing the steps of: 

a. acquiring a first SIM image of an IC 75 
device at a selected field of view; 

b. storing the first image as a plurality of 
pixels, each pixel defined by a location with- 
in an x-y grid and an intensity value; 

b. storing first coordinates defining the se- 20 
lected field of view; 

c. storing operating parameters defining a 
FIB operation to be carried out on an IC 
device at a selected location within the se- 
lected field of view; 25 

d. retrieving a first patch comprising of nxn 
pixels of the first image; 

e. preparing a first Laplacian patch by con- 
volving intensity values of pixels of the first 
patch with values of a zero-mean Laplacian 30 
kernel, the first Laplacian patch comprising 

a plurality of pixels in which each pixel is 
defined by a location within an x-y grid and 
an intensity value having a sign; 

f. preparing a first registration image by 35 
convolving intensity values of pixels of the 

first Laplacian patch with a Gaussian kernel 
along two axes of an x-y grid, the first 
registration image describing a plurality of 
pixels in which each pixel is defined by a 40 
location within an x-y grid and an intensity 
value having a sign; 

g. preparing a first binarized image by con- 
verting intensity values of pixels of the first 
registration image to respective binary val- 45 
ues in dependence upon the sign of the 
intensity value, the data defining the first 
binarized image describing a plurality of 
pixel locations within an x-y grid and a 
binary value for each pixel location; 50 

h. acquiring a second SIM image of an IC 
device to be modified at approximately the 
selected field of view; 

i. selecting a second patch comprising mxm 
pixels of the second image; 55 
j. preparing a second Laplacian patch by 
convolving intensity values of pixels of the 
second patch with values of a zero-mean 



Laplacian kernel, the second Laplacian 
patch comprising a plurality of pixels in 
which each pixel is defined by a location 
within an x-y grid and an intensity value 
having a sign; 

k. preparing a second registration image by 
convolving intensity values of pixels of the 
second Laplacian patch with a Gaussian 
kernel along two axes of an x-y grid, the 
second registration image comprising a plu- 
rality of pixels in which each pixel is defined 
by a location within an x-y grid and an 
intensity value having a sign; 
I. preparing a second binarized image by 
converting intensity values of pixels of the 
second registration image to respective bi- 
nary values in dependence upon the sign of 
the intensity value, the first binarized image 
comprising a plurality of pixel locations with- 
in an x-y grid and a binary value for each 
pixel location; 

m. for each of a plurality of possible offset 
of the second binarized image relative to 
the first binarized image for which mxm 
pixels of the second binarized image are 
aligned with mxm pixels of the first binariz- 
ed image, 

(1) performing an EXOR operation for 
each of mxm pixel locations between the 
binary value of the binarized first reg- 
istration image and the binary value of 
the binarized second registration image 
to produce a binary pixel-correlation val- 
ue per pixel location; and 

(2) determining a sum of the binary pixel- 
correlation values to obtain an image- 
correlation value; 

n. comparing the image-correlation values 
to identify an offset of the second binarized 
image relative to the first binarized image 
which results in a maximum correlation be- 
tween the second binarized image and the 
first binarized image; 

o. preparing corrected operating parameters 
by correcting the stored operating param- 
eters in accordance with the identified off- 
set; and 

p. carrying out the FIB operation defined by 
the corrected operating parameters. 
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© Determining offset between images of an IC. 
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© Offset between a pair of images is determined 
using parallel processing techniques in a general- 
purpose digital serial processor. For each image, a 
patch of pixels is selected and convolved with a 
Laplacian kernel. The result is convolved with a 
Gaussian kernel in each of the x- and y- directions to 
produce a registration image. The registration im- 
ages are binarized, bit-packed, and correlated to one 
another by performing an EXOR operation for each 
pixel location at each of a plurality of relative offsets 



of the images. The results of the EXOR operation 
are summed to produce an image-correlation value 
for each relative offset. The image-correlation in- 
dicating highest correlation determines relative offset 
of the images. The determined offset can be used 
for a variety of purposes in automating control of E- 
beam and FIB systems, to register images to one 
another or to identify a location in one image which 
corresponds to a selected location of the other im- 
age. 
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